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Abstract. Maximum Satisfiability (MaxS AT) is a well-known optimization pro- 
blem, with several practical applications. The most widely known MaxS AT algo- 
rithms are ineffective at solving hard problems instances from practical applica- 
tion domains. Recent work proposed using efficient Boolean Satisfiability (SAT) 
solvers for solving the MaxSat problem, based on identifying and eliminating 
unsatisfiable subformulas. However, these algorithms do not scale in practice. 
This paper analyzes existing MaxSat algorithms based on unsatisfiable subfor- 
mula identification. Moreover, the paper proposes a number of key optimizations 
to these MaxS AT algorithms and a new alternative algorithm. The proposed opti- 
mizations and the new algorithm provide significant performance improvements 
on MaxSat instances from practical applications. Moreover, the efficiency of 
the new generation of unsatisfiability-based MaxSat solvers becomes effec- 
tively indexed to the ability of modern SAT solvers to proving unsatisfiability 
and identifying unsatisfiable subformulas. 



1 Introduction 

The problem of Maximum Satisfiability (MaxSat) consists of identifying the largest 
number of clauses in a CNF formula that can be satisfied. Variations of the MaxSat 
include partial MaxSat and weighted MaxSat. For partial MaxSat some clauses 
(i.e. the hard clauses) must be satisfied whereas others (i.e. the soft clauses) may not be 
satisfied. For weighted MaxSat, each clause has a given weight, and the objective is 
to maximize the sum of the weights of satisfied clauses. 

The MaxSat problem and its variations find a number of relevant practical appli- 
cations, including design debugging of embedded systems [25] and FPGA routing [30]. 
Unfortunately, the techniques that have proved to be extremely effective in Boolean Sat- 
isfiability (SAT) cannot be applied direcdy to MaxSat [2, 14]. As a result, most of the 
existing algorithms [10, 16, 17, 6] implement only a restricted number of techniques, 
emphasizing bound computation and/or dedicated inference techniques. Despite the ex- 
tensive research work in this area, existing MaxSat techniques and algorithms do not 
scale for large problem instances from practical applications. 

Recent work [6] proposed alternative approaches, that build on the existence of ef- 
fective SAT solvers for identifying unsatisfiable subformulas, and so can indirectly ex- 
ploit existing effective SAT techniques [21, 22,4]. However, even though modern SAT 
solvers are effective at proving unsatisfiability and generating unsatisfiable subformu- 
las, the algorithms described in [6] are in general ineffective for MaxSat, and so this 
work focused on partial MaxSat with a reduced number of soft clauses. 



This paper reviews previous MaxS AT algorithms based on identifying unsatisfiable 
subformulas for MaxSat, proposes key optimizations to one of these algorithms [6], 
and develops a new algorithm also based on identifying unsatisfiable subformulas. Ex- 
perimental results, obtained on a wide range of practical problem instances, show that 
the new MaxSat algorithms can be orders of magnitude more efficient than the origi- 
nal algorithms [6], being in general consistently more efficient than previous MaxSat 
solvers on instances obtained from practical applications. 

The paper is organized as follows. Section 2 briefly introduces the MaxSat prob- 
lem and existing algorithms. Afterwards, Section 3 reviews MaxSat algorithms based 
on unsatisfiable subformula identification [6]. Section 4 proposes optimizations to these 
algorithms, and Section 5 proposes a new MaxS AT algorithm. Experimental results on 
a large sample of problem instances, obtained from a number of practical applications, 
are analyzed in Section 6. The paper concludes in Section 7. 



2 Preliminaries 

This section provides definitions and background knowledge for the MaxS AT problem. 
Due to space constraints, familiarity with SAT and related topics is assumed [21,4]. 

The maximum satisfiability (MaxSat) problem can be stated as follows. Given an 
instance of SAT represented in Conjunctive Normal Form (CNF), compute an assign- 
ment to the variables that maximizes the number of satisfied clauses. Variations of the 
MaxSat problem include the partial MaxSat and the weighted MaxSat problem. 
In the partial MaxSAT problem some clauses (i.e. the hard clauses) must be satisfied, 
whereas others (i.e. the soft clauses) may not be satisfied. In the weighted MaxSAT 
problem, each clause has a given weight, and the objective is to maximize the sum of 
the weights of satisfied clauses. 

During the last decade there has been a growing interest on studying MaxSat, mo- 
tivated by an increasing number of practical applications, including scheduling, routing, 
bioinformatics, and design automation [30, 25]. Despite the clear relationship with the 
SAT problem, most modern SAT techniques cannot be applied directly to the MaxS AT 
problem [2, 14]. As a result, most MaxSat algorithms are built on top of the stan- 
dard DPLL [3] algorithm, and so do not scale for industrial problem instances [10, 
16, 17,6]. The most often used approach for MaxSat (e.g. most of the solvers in the 
MaxSat competition [1]) is based on a Branch and Bound algorithm, emphasizing the 
computation of a lower bound and the application of inference rules that simplify the 
instance [10, 16, 17]. Results from the MaxSat competition [1] indicate that solvers 
based on Branch and Bound with additional inference rules are currently the most effi- 
cient MaxSat solvers, outperforming all other existing approaches. 

One alternative approach for solving the MaxS AT problem is to use Pseudo-Boolean 
Optimization (PBO) (e.g. [18]). The PBO approach for MaxSat consists of adding a 
new (blocking) variable to each clause. The blocking variable bi for clause uui allows 
satisfying clause uji independently of other assignments to the problem variables. The 
resulting PBO formulation includes a cost function, aiming the minimization of the 
number of blocking variables assigned value 1. Clearly, the solution of the MaxS AT 



problem is obtained by subtracting from the number of clauses the solution of the PBO 
problem. 

Despite its simplicity, the PBO formulation does not scale for industrial problems, 
since the large number of clauses results in a large number of blocking variables, and 
corresponding larger search space. Observe that, for most instances from practical ap- 
plications, the number of clauses largely exceeds the number of variables. For the re- 
sulting PBO problem, the number of variables equals the sum of the number of variables 
and clauses in the original SAT problem. Hence, the resulting instance of PBO has a 
much larger search space than the original instance of SAT. 

Besides the PBO model, a number of alternative algorithms exist for MaxSat. Ex- 
amples include, OPT-SAT [8] and sub-SAT [30]. OPT-SAT imposes an ordering on the 
Boolean variables on an existing SAT solver Experimental results for MaxSat indi- 
cate that this approach is slower than a state-of-art PBO solver, e.g. miiiisat+ [5], and 
so it is unlikely to scale for industrial problems. On the other hand, sub-SAT solves 
a relaxed version of the original problem, hence the exact MaxSat solution may not 
be computed. Moreover, the experimental comparison in [6] suggests that sub-SAT 
is not competitive with unsatisfiability-based MaxSat algorithms. Other approaches 
have been proposed [9], that are based on the relation of minimally unsatisfiable sub- 
formulas and maximally satisfiable subformulas [18, 9]. However, these approaches are 
based on enumeration of maximally satisfiable subformulas, and so do not scale for in- 
stances with a large number of unsatisfiable subformulas. As a result, for most instances 
only approximate results can be obtained. More recently, an alternative approximate 
approach to MaxSat has been proposed [25]. The motivation for this alternative ap- 
proach is the potential application of MaxSat in design debugging, and the fact that 
existing MaxSat approaches do not scale for industrial problem instances. However, 
this approach is unable to compute exact solutions to the MaxSat problem. 

The next section addresses MaxSat algorithms that use the identification of un- 
satisfiable subformulas. Modern SAT solvers can be instructed to generate a resolution 
refutation for unsatisfiable formulas [32]. The resolution proof is usually represented as 
a proof trace, which summarizes the resolution steps used for creating each clause learnt 
by the SAT solver Besides resolution refutations, proof traces allow identifying unsat- 
isfiable subformulas, which serve as the source for the resolution refutation. A simple 
iterative procedure allows generating minimal unsatisfiable subformulas (MUS) from 
computed unsatisfiable sub-formulas [32]. All modern conflict-driven clause learning 
(CDCL) SAT solvers can be easily adapted to generate proof traces, and indirectly, 
unsatisfiable sub-formulas. 

3 Unsatisfiability-Based IMaxSat Algorithms 

As mentioned in the previous section, one of the major drawbacks of the PBO model for 
MaxSat is the large number of blocking variables that must be considered. The ability 
to reduce the number of required blocking variables is expected to improve significantly 
the ability of SAT/PBO based solvers for tackling instances of MaxSat. Moreover, 
any solution to the MaxS AT problem will be unable to satisfy clauses that must be part 
of an unsatisfiable subformula. Consequently, one approach for reducing the number 



Algorithm 1 The MaxSat algorithm of Fu&Malik 

MSUl(v5) 



1 O Clauses of CNF formula ip are the initial clauses 

2 [> Clauses in tp are tagged non-auxiliary 

3 ifw f > Working formula, initially set to tp 

4 while true 

5 do (st,vpc) ^ SAT(</3w) 

6 > ifc is an unsat core if ipw is unsat 

7 if st = UNSAT 

8 then BV *- ^ 

9 for each uj £ tpc 

10 do if a; is not auxiliary 

1 1 then 6 is a new blocking variable 

12 u)b <— a; U {6} > lob is tagged non-auxiliary 

13 pw ^ — {<jj} U {lob} 

14 BV ^ BV\J {b} 

15 PB ^ CNF(5]jg5^ 6=1) O One-Hot constraint in [6] 

16 ip-w <— <(Jiv U > Clauses mipB are tagged auxiliary 

17 else o Solution to MaxSat problem 

18 1 blocking variables w/ value 1 

19 return \ip\ — v 



of blocking variables is to associate blocking variables only with clauses that are part 
of unsatisfiable subformulas. However, it is not simple to identify all clauses that are 
part of unsatisfiable subformulas. One alternative is the identification and relaxation of 
unsatisfiable subformulas. 

This section describes the unsatisfiability-based MaxSat algorithm described in [6]. 
In what follows this algorithm is referred to as msul (Fu&Malik's MaxSat algorithm 
based on unsatisfiable subformulas). It should be observed that the original algorithm 
was proposed for partial MaxSat, but the modifications for the plain MaxSat prob- 
lem are straightforward. 

Algorithm 1 summarizes Fu&Malik's [6] MaxSat algorithm. The algorithm itera- 
tively finds unsatisfiable cores (line 5), adds new blocking variables to the non-auxiliary 
clauses in the unsatisfiable core (line 12), and requires that exactly one of the new 
blocking variables must be assigned value 1 (line 15). This constraint is referred to as 
the One-Hot constraint in [6]. The algorithm terminates whenever the CNF formula is 
satisfiable, and the number of assigned blocking variables is used for computing the 
solution to the MaxSat problem instance. 

The clauses used for implementing the One-Hot constraint are declared auxiliary; 
all other clauses are non-auxiliary. Observe that each non-auxiliary clause may receive 
more than one blocking variable, and the total number of blocking variables a clause 
receives corresponds to the number of times the clause is part of an unsatisfiable core. 
As suggested earlier in this section, by focusing on identification and relaxation (with 
blocking variables) of unsatisfiable sub-formulas, msul and the other algorithms de- 
scribed later attempt to reduce the number of blocking variables that is necessary to use 
while solving the Max Sat problem. 



A proof of correctness of algorithm msul is given in [6]. However, [6] does not ad- 
dress important properties of the algorithm, including the number of blocking variables 
that must be used in the worst case, or the worst-case number of iterations of the algo- 
rithm. This section establishes some of these properties. In what follows, n denotes the 
number of variables and m denotes the number of clauses. 

Proposition 1. During the execution of Algorithm 1, non-auxiliary clauses can have 
multiple blocking variables. 

Proof: Consider the following example CNF formula: 

(xi) A (-.xi V -^yi) A (yi) A {^xi V -.zi) A {^yi V -^zi) 
{x2) A {^X2 V ^1/2) A (2/2) A {^X2 V -izi) A {^y2 V -^zi) 
(zi V Z2) A (zi V -122) 

One possible execution of the algorithm follows. Identify core (xi ) A (-1X1 V -^yi ) A (yi ) . 
Add blocking clauses, respectively bi,b2,b3, and require 61 + 62 + &3 = 1. Identify core 
{X2) A (-1X2 V ^j/2) A (2/2)- Add blocking clauses, respectively 64, 65, fee- ^nd requte 
64 + 65 + 65 = 1- Identify core (xi V 61 ) A (j/i V 63) A (-ixi V -^Zi ) A {^yi V -^Zi ) A (zi V 
■^2 ) A (zi V -1Z2 ) A (ySe , where (pe denotes clauses from encoding 61 + &2 + &3 = 1 in CNF. 
Add blocking clauses to non-auxiliary clauses, respectively bj,bs,bg,biQ,bii,bi2, and 
require 67 + 63 + ^9 + &10 + &11 + &12 = 1- At this stage, some of the non-auxiliary 
clauses have two blocking variables, e.g. bi and bj are associated with {xi). ■ 

Proposition 2. During the execution of Algorithm l,for iteration j, exactly j — 1 block- 
ing variables must be assigned value 1, or the formula is unsatisfiable. 

Proof: Observe that each iteration adds a constraint requiring the sum of a set of new 
blocking variables to be equal to 1. Hence, at iteration j, either j — 1 blocking variables 
are assigned value 1, or the formula is unsatisfiable. ■ 

Proposition 3. During the execution of Algorithm 1, if (fw is satisfiable, at most 1 of 
the blocking variables associated with a given clause can be assigned value I. 

Proof: Each blocking variable is associated with a clause as the result of identifying an 
unsatisfiable core. Consider clause oji that is part of two cores c\ and C2 , each adding to 
oji a blocking variable, respectively bi,i and bi,2. Assume that the formula could be sat- 
isfied such thatuji would have the two blocking variables bi i and bi^2 assigned value 1. 
This would imply that both cores ci and C2 could be deactivated by blocking clause uji. 
But this would also imply that the second core C2 could not have been identified, since 
assigning bi i would deactivate core C2 ; a contradiction. ■ 

This result allows deriving an upper bound on the number of iterations of Algo- 
rithm 1. 

Proposition 4. The number of iterations of Algorithm 1 is 0{m). 

Proof: Immediate from Propositions 2 and 3. At each iteration j, j ~ I blocking vari- 
ables must be assigned value 1. Moreover, none of these blocking variables can be from 



the same clause. Hence, at iteration m + I all clauses must be satisfied by assigning a 
blocking variable to 1. Hence, the number of iterations of Algorithm 1 is 0{m). ■ 

It should be observed that the algorithm will never execute m + 1 steps. Indeed, 
for arbitrary CNF formulas, at least half of the clauses can be trivially satisfied [12], 
and so the number of iterations never exceeds ^ + 1. Moreover, the upper bound on 
the number of iterations serves for computing an upper bound on the total number of 
blocking variables. 

Proposition 5. During the execution of Algorithm 1, the number of blocking variables 
is 0(m?) in the worst case. 

Proof: From Proposition 4 the number of iterations is 0{m). In each iteration, each un- 
satishable core can have at most m clauses (i.e. the number of original clauses). Hence 
the result follows. ■ 

The previous result provides an upper bound on the number of blocking variables. 
A tight lower bound is not known, even though a trivial lower bound is i?(m). 

4 Optimizing Unsatisfiability-Based MaxSat Algorithms 

This section proposes improvements to Fu&Malik's MaxSat algorithm [6] described 
in the previous Section. The resulting algorithm is referred to as msu2. 

4.1 Encoding Cardinality Constraints 

The one-hot constraint used in msul [6] corresponds to the well-known pairwise encod- 
ing for Equals 1 constraints [7], i.e. cardinality constraints of the form ^« ~ 1- 
Usually, Equals 1 constraints are encoded with two constraints, one AtMost 1 con- 
straint (i.e. X]i^=i — 1) ^'I'l oti^ AtLeast 1 constraint (i.e. — !)■ ^1^° 
well-known that the pairwise encoding requires '•'2'"'"'' + 1 clauses, one clause for the 

AtLeast 1 constraint, and '' ^'2"^'' binary clauses for the AtMost 1 constraint. Hence, the 
quadratic number of clauses results from encoding the AtMost 1 constraint. For large r, 
as is often the case for the MaxSat problem, the pairwise encoding can require a pro- 
hibitively large number of clauses. For example, for an unsatisfiable core with 10,000 
clauses, the resulting AtMost 1 constraint is encoded with 49,995,000 binary clauses. 
For practical applications, unsatisfiable cores are likely to exceed 10,000 clauses. As 
shown in Section 6, in many cases, the pairwise encoding of an AtMost 1 constraint 
exhausts the available physical memory resources. 

There are a number of alternatives to the pairwise encoding of AtMost 1 con- 
straints [29, 7, 26, 5], all of which are linear in the number of variables in the constraint. 
These encodings can either use sequential counters, sorters, or binary decision diagrams 
(BDDs). One simple alternative is to use BDDs for encoding a cardinality constraint. A 
Boolean circuit is extracted from the BDD representation, which can then be converted 
to CNF using Tseitin's encoding [28]. In most cases, the encoding takes into account 
the polarity optimizations of Plaisted and Greenbaum [24, 5] when generating the CNF 



formula. For the AtMost 1 constraint, the BDD-based encoding of a cardinaUty con- 
straint is linear in n [5]. For the results in Section 6, the most significant performance 
gains are obtained from using a BDD-based encoding for AtMost 1 constraints, using 
Tseitin's encoding and Plaisted&Greenbaum's polarity optimizations. 

One final remark is that Fu&Malik's algorithm will also work if only AtMost 1 
constraints are used instead of Equals 1 constraints. This allows saving one (possibly 
quite large) clause in each iteration of the algorithm. 

4.2 Blocking Variables Associated with each Clause 

Another potential drawback of Fu&Malik's algorithm is that there can be several block- 
ing variables associated with a given clause (see the analysis of Algorithm 1, including 
Propositions 1 and 5). Each time a clause oj is part of a computed unsatisfiable core, 
a new blocking variable is added to lo. Observe that correctness of the algorithm re- 
quires that more than one blocking variable may be associated with each clause. On the 
other hand, despite the potentially large (but at most linear in m) number of blocking 
variables associated with each clause, at most one of these additional blocking variables 
can be used for actually preventing the clause from participating in an unsatisfiable core 
(see Proposition 3). 

A simple improvement for pruning the search space associated with blocking vari- 
ables is to require that at most one of the blocking variables associated with a given 
clause u) can be assigned value 1 . For a given clause oji, let hi,j be the blocking variables 
associated with cj;. As a result, the condition that at most 1 of the blocking variables of 
uji is assigned value 1 is given by: 



In general, the previous condition is useful when Algorithm 1 must execute a large 
number of iterations, and many clauses are involved in a significant number of unsatis- 
fiable cores. 

Example 1. Consider the example given in the proof of Proposition 1. In the third it- 
eration of the algorithm, the first clause {xi) has been modified to [xi V &i V 67). As 
a result, the CNF encoding of the additional constraint 61+67 < 1 can be added to 
the CNF formula. Since this is an AtMost 1 constraint, the encoding proposed in the 
previous section can also be used. 

5 A New Unsatisfiability-Based MaxSat Algorithm 

This section proposes a new alternative algorithm for MaxSat. Compared to the algo- 
rithms described in the previous sections, msul and msu2, the new algorithm guarantees 
that at most 1 blocking variable is associated with each clause. As a result, the worst 
case number of blocking variables that can be used is m. Moreover, during a first phase, 
the new algorithm extracts identified cores, whereas in a second phase the algorithm 
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Algorithm 2 A new MaxSat algorithm 
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> Working formula, initially set to i^p 



UC ^ 
while true 

do (st,v9c) ^ SAT(<^w/) 
if St = UNSAT 
then ipw ^ ipw — ipc 
UC^UCU{(/9c} 
else break 

BV ^ 

for each ipc G UC 

do for each lj & (pc 

do fe is a new blocking variable 

BV BV\J{h} 
tpw ^ ipw U {a; U {h}} 

A = |UC| 

ipw ipw U ifB 

while true 

do (st,v9c) <~ SAT{(pw) 
if St = UNSAT 
then A ^ A + 1 

for each lu £ (pc 

do if uj has no blocking variable 

then b is new blocking variable 
Ub <— U {b} 
(fiw ^ - {<jj} U {cob} 
BV <- BVu{b} 
ipw ^ H>w — H^b 

ipB ^ CNF(X](,GBV ^ = ^) I> New cardinality constraint 

ipw <— i-pw y^PB > Clauses in ly^s are tagged auxiliary 

else return — A o Solution to MaxSat problem 



O Phase 1: Identify disjoint cores 
> pic is an unsat core if p>w is unsat 



> Move to 2nd loop 
> Add blocking variables 

[> Lower bound on true blocking variables 

> Current cardinality constraint 

> Phase 2: Increment lower bound A 

> PC is an unsat core if kpw is unsat 



[> ojb is tagged non-auxiliary 



addresses the problem of computing the number of blocking variables that must be as- 
signed value 1. The objective of the first phase is to simplify identification of disjoint 
unsatisfiable cores. 

Algorithm 2 shows the new MaxS AT algorithm. The first phase of the algorithm is 
shown in lines 3 to 8. During this phase disjoint cores are identified and removed from 
the formula. The first set of blocking variables are associated with each clause in an 
unsatisfiable core in lines 9 to 14. The second phase of the algorithm is shown in lines 1 8 
to 3 1 . During this phase the lower bound on the number of blocking variables assigned 
value 1 is iteratively increased until the CNF formula becomes satisfiable. For each 
identified unsatisfied core, a unique blocking variable is associated with non-auxiliary 
clauses that do not have a blocking variable. The cardinality constraint 'Y^hi = fc is 
encoded with one AtLeast fc hi < k) and one AtMost fc bi > fc) constraints. As 
with msu2, these constraints are represented with BDDs and converted to CNF using 



Tseitin's transformation [28] and including the polarity optimizations of Plaisted and 
Greenbaum [24, 5]. In this case the size of the representation if 0{r ■ k), where r is the 
number of variables [5] and k is the cardinality constraint bound. 

Despite msu3 guaranteeing that the number of blocking variables never exceeds m, 
there are a few potential drawbacks. The AtLeast k and AtMost k cardinality constraints 
used by msu3 are significantly more complex to encode than the simple AtMost 1 con- 
straint used by msul and msu2. As a result, msu3 is expected to perform better when 
the MaxSat solution is not far from the total number of clauses. 

As mentioned earlier for msul. Algorithm 2 can use AtMost k cardinality con- 
straints instead of Equals k constraints. Finally, algorithm msu2 also allows evaluating 
whether two phases can be useful for solving MaxSat. Clearly, the algorithm could 
easily be modified to also use only one phase. 

6 Experimental Evaluation 

This section evaluates a number of MaxSat solvers on industrial test cases. Most in- 
stances are obtained from unsatisfiable industrial instances used in past SAT competi- 
tions [15] or available from SATLIB [11]. The classes of instances considered were the 
following: 

1. Bounded model checking sintances from IBM [31]. The problem instances were 
restricted to unsatisfiable instances, up to 35 computation steps, for a total of 252. 

2. Instances from the parametrized pipelined-processor verification problem [19]. The 
problem instances were restricted to the smallest 58 instances. 

3. Verification of out-of-order microprocessors, from UCLID [13]. 31 unsatisfiable 
instances were considered. 

4. Circuit testing instances [11]. 228 unsatisfiable instances were considered. 

5. Automotive product configuration [27]. 84 unsatisfiable instances were considered. 

In addition, instances from design debugging [25] (29 unsatisfiable instances) and 
FPGA routing [30] (16 unsatisfiable instances) were also considered. These MaxSat 
instances are known to be difficult, and most have no known MaxSat solutions. As a 
result, the total number of problem instances used in the experiments was 698. 

The MaxSat solvers considered were the following: the best performing solver 
in the MaxSat 2007 evaluation [1], maxsatz [16, 17], a PBO formulation of the 
MaxSat problem solved with minisat+, one of the best performing PBO solvers [5, 
20], an implementation of the algorithm based on identification of unsatisfiable cores 
(msul) [6], msul with the improvements proposed in Section 4 (msu2), and the new 
MaxSat algorithm described in Section 5 (msu3). msul, msu2 and msu3 are built on 
top of the same unsatisfiable core extractor, implemented with minisat 1.14 [4]. 

Other alternative MaxSat algorithms were not considered [8,30,9, 18]. Existing 
results for OPT-SAT indicate that it is not competitive with the PBO model solved with 
minisat+. On the other hand, both sub-SAT [30] and HYCAM [9] only compute approx- 
imate solutions. Moreover, results from [9] also show that existing approaches based on 
enumerating all minimally unsatisfiable subformulas [18] are not competitive. 
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Fig. 1. Run times on all instances 
Table 1. Number of aborted instances, out of a total of 698 instances 



MaxSat solver 


maxsatz PBO msul msu2 msu3 


Aborted instances 


564 261 228 84 82 



With respect to the PBO model, minisat+ was configured to use sorters for the 
cost function. The reason for using sorters is that for many problem instances the use of 
BDDs would exhaust the available physical memory. 

The results for all MaxSat solvers on all problem instances were obtained on a 
Linux server running RHE Linux, with a Xeon 5160 3.0 GHz dual-core processor. For 
the experiments, the available physical memory of the server was 2 GByte. The time 
limit was set to 1000 seconds per instance. 

Figure 1 plots the run times of each solver sorted by increasing run times. As can be 
observed, the performance difference for the MaxS AT solvers considered is significant. 
msu2 and msti3 solve many more problem instances than any of the other solvers. As 
can also be observed in Figure 1, msul exhibits a sharp transition between instances 
it can solve and instances it is unable to solve. The reason is due to the size of the 
computed unsatisfiable cores. For the more complex instances, the size of the cores is 
significant, and so msul most often aborts due to excessive memory requirements. 

A summary of the number of aborted instances is shown in Table 1 . Over all in- 
stances, msu2 aborts 2 more instances than msti3 (respectively 84 vs. 82), and both 
abort significantly less instances than any of the other solvers, msul aborts 146 more in- 
stances than msu3 and 144 more instances than msu2. Somewhat surprisingly, the PBO 
model performs reasonably well when compared with msul. As might be expected, 
maxsatz aborts most industrial instances. 

Figure 2 compares msul with maxsatz and PBO, respectively. As can be seen, 
with the exception of a few outUers, always taking negUgible CPU time, msul performs 




Fig. 2. Scatter plots on all instances maxsatz and PBO vs. msul 



significantly better than maxsatz. In contrast, msul does not clearly outperform PBO. 
This is in part explained by the quadratic encoding of AtMost 1 constraints in msul, 
which causes a significant number of instances to abort. In addition, the PBO model 
uses the most recent version of minisat+, whereas the unsatisfiable core extractor used 
in all versions of the msu algorithm is based on minisat 1 . 14. 

Figure 3 compares msu2 against PBO and msul. The performance difference is 
clear. msu2 outperforms msul in almost all problem instances. For a very small number 
of examples, msul can outperform msu2, but the differences are essentially negligi- 
ble, never exceeding a small percentage of the total run time. msu2 also clearly out- 
performs PBO, aborting a fraction (close to 20%) of the instances aborted by PBO. 
However, a few outliers exist, and these are explained by the fact that PBO uses the 
most recent version of minisat +, and msu2 uses an unsatisfiable core extractor based 
on minisat 1.14. 

Figure 4 compares msu3 against msul and msu2. msul performs significantly worse 
than msu3, with a few outliers, only one of which is relevant. In contrast, msu2 and msu3 
perform similarly, even though msu2 usually exhibits smaller run times. Nevertheless, 
the results also suggest that msu3 can be an interesting alternative to msu2 for a reason- 
able number of problem instances. 

The previous results provide clear evidence that unsatisfiability -based MaxSat 
algorithms are effective for solving problem instances obtained from industrial set- 
tings. However, several of the problem instances considered, albeit unsatisfiable, do 
not represent problems originally formulated as MaxSat problems. Recent work has 
shown that MaxSat has practical application in FPGA routing [30] and system de- 
bugging [25]. However, and motivated by the limitations of existing MaxSat solvers, 
these MaxSat instances were solved with approximate algorithms. Our results indicate 
that unsatisfiability -based MaxSat algorithms are very efficient at solving problem in- 
stances from design debugging, but less effective at solving FPGA routing instances. 
The class FPGA contains 16 unsatisfiable instances. Of these 16, msu2 solves 3, msul 




Fig. 3. Scatter plots on all instances, PBO and msul vs. msu2 



solves 2, msu3 solves 1, and maxsatz solves 1. It is well-known that SAT instances 
from FPGA routing have specific structure, that makes them quite difficult for SAT 
solvers [23,30]. This in part explains the results of all MaxSat solvers on these in- 
stances. 

For the design debugging instances the results are quite different. Table 6 shows 
the CPU times for all MaxSat solvers on all design debugging instances [25]. As 
before, the unsatisfiability-based MaxSat algorithms perform remarkably better than 
the other algorithms, maxsatz and the PBO model. In addition, and also as before, 
msu2 is the best performing algorithm, and aborts only one instance. msu3 also aborts 
only one instance, but in general performs worse than msu2. Finally, msul aborts 2 
instances, and performs worse than msu2 for almost all instances. For instances with 
large unsatisfiable cores (e.g. bl5-bug-onevec-gate-0) the linear encoding used in msu2 
ensures manageable size representations of the AtMost 1 constraints. The same holds 
true to msu3, for small values of k. In contrast, msul uses a quadratic encoding and so it 
often aborts instances with large unsatisfiable cores. Moreover, for instances requiring 
the identification of several unsatisfiable cores sharing common clauses, the additional 
constraints proposed in Section 4.2 are useful for msu2. It should be observed that the 
only design debugging instance that is aborted by both msu2 and msu3 is also aborted 
by the unsatisfiable core extractor, again suggesting that performance of unsatisfiabiUty- 
based MaxSat solvers is indexed to the efficiency of SAT solvers. 

7 Conclusions 

Recent work has shown that MaxSat has a number of significant practical applica- 
tions [25]. However, current state of the art MaxSat solvers are ineffective on most 
problem instances obtained from practical applications. 

This paper focus on solving MaxSat problem instances obtained form practical 
applications, and conducts a detailed analysis of MaxSat algorithms based on unsat- 
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isfiable subformula identification. Moreover, the paper develops improvements to exist- 
ing algorithms and proposes a new MaxSat algorithm. The proposed improvements 
(msu2) and new algorithm (msu3) provide significant performance improvements, and 
allow indexing the hardness of solving practical instances of MaxSat to the ability 
of modern SAT solvers for proving unsatisfiability and identifying unsatisfiable sub- 
formulas. The algorithms described in this paper are by far the most effective for in- 
stances obtained from practical appUcations, clearly outperforming existing state of the 
art MaxSat solvers, and further improvements are to be expected. 

Despite the promising results of the new MaxS AT algorithms, a number of research 
directions can be envisioned. As the experimental results show, the role of encoding car- 
dinality constraints is significant, and an extensive evaluation of alternative encodings 
should be considered. The unsatisfiable core extractor is based on minisat 1.14. A 
core extractor based a more recent SAT solver is expected to improve the efficiency 
of msul, msu2 and msu3. Finally, the problem instances for the FPGA routing prob- 
lem are still challenging, even though the new MaxSat algorithms can solve some of 
these instances, and so motivate the development of further improvements to MaxSat 
algorithms. 
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